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ABS131ACT 


We  define  the  complete  problemof a  two-stage  linear  programming 
under  imcertalnty,  to  bei 

Minimize  z(x)  =  {  c  x  +  +  q"y~  } 

subject  to  Ax  =  b 

Ix  +  Iy+  +  ly-  B  u 
y'^O 

where  x  is  the  first-stege  decision  varieble,  the  pair  (y^ ,y“) 
represents  the  second-stage  decision  variables*  In  order  to  solve 
this  class  of  problemi  we  derive  a  convex  programming  problemi 
whose  set  of  optimal  solutions  is  identical  to  the  set  of  optimal 
solutions  of  our  original  problem*  This  problem  is  celled  the 
equivalent  convex  programming*  If  the  random  variable  %  has  a 
continuous  distribution,  we  give  an  algorithm  to  solve  the  equivalent 
convex  program*  Moreoveri  we  derive  eaqjlicitly  the  equivalent  convex 
program  for  a  few  common  distributions* 
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I.  INTRODUCTION 


The  standard  form  for  the  two-stage  linear  program  \indcr  uncertainty 
is: 

(1)  Minimize  z(x)  =  {cx  +  qyj 

subject  to  Ax  =  b 

Tx  t  =  C  C  t  (Z ,  8  »  F) 

X  >  0  y  >  0 

where  A  is  a  matrix  mxn,  T  is  mxn,M  is  mxn,  (  isa  random 
vector  whose  probability  space  is  (Sf  8  ,F)  *  This  problem  (1)  belongs  to 
the  class  of  stochastic  linear  programming  problems  for  which  one  seeks  a 
here -end-now  solution*  One  interprets  problem  (1)  as  follows:  the 
decision  maker  selects  the  activity  levels  for  x,  say  x  =  x,  he  then 

A 

observes  the  random  event  (»  =  5  and  he  is  finally  allowed  a  corrective 

^  A 

action  y  ,  such  that  y^0|  1^  =  5  -  Tx  and  qy  is  minimum.  This  second 
stage  decision  y  ,  is  taken  when  no  "uncertainties"  are  left  in  the  problem. 

The  decision  maker  wants  to  minimize  the  sum  of  his  fixed  costs  (cx) 
and  of  the  penalty  costs  he  may  expect  when  he  has  selected  given  activity 
levels  (x).  It  is  clear  from  this  interpretation  that  we  could  also  write 
the  objective  function  of  (1) 

(2)  z(  x)  =  cx  +  {  min  qy  I  x  }  . 

All  quantities  considered  here  belong  to  the  reals,  denoted  R  .  Vectors 
will  belong  to  finite-dimensional  real  vector  spaces  R*^  and  whether  they 
are  to  be  regarded  as  row  vectors  or  column  vectors  will  always  be  clear  from 
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the  context  in  which  they  appear.  Thus,  for  example,  the  expressions 

Tx  =  X 

i=l 

are  easily  understood.  No  special  provisions  will  be  made  for  transposing 
vectors. 

The  random  vector  C  s  ((.  ....  1^.  . K^)  Is  a  "numerical** 

j.  1  m 

«■ 

random  vector,  l.e.  Z  ft  is  an  algebra  or  a  o  -  algebra  and  F  is 

a  probability  distribution  function  from  which  could  be  obtained  a  probabil¬ 
ity  measure.  (Z^  i  0^  ,  F^)  is  the  probability  space  of  the  random  variable 

We  oiuy  need  independence  of  (  and  x  t  our  first-stage  decision  has  then 
no  effect  on  (ZfO,F)  . 

If  for  every  finite  interval,  ®  finite  number  of  discontinu¬ 

ity  points,  then  we  can  always  integrate  by  parts  ygi(5i)dFi(ti)  ,  where 

gl(Ci)  is  a  linear  function  of  .  If  it  exists,  we  denote  the  density 

function  of  by  i  =  l,**.,m  and  let  and  be  respectively 

the  greatest  lower  bound  and  least  upper  bound,  if  they  exist,  of  .  We 

assume  that  E,  { (.  }  exists  for  all  1=1, . . 

'l  ^ 

We  say  that  problem  (1)  is  complete  when  the  matrix  M  (after  an  appropriate 
rearrangement  of  rows  and  columns) can  be  partitioned  in  two  parts,  whose  first 
part  is  an  Identity  matrix  and  the  second  part  is  the  negative  of  an  Identity 
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natrlXf  M  *  (If  -l)  • 

The  etanderd  form  of  the  problem  to  be  etudied  in  thif  ertiele  Is  then 

(3)  Minimize  z(x)  »  E^{ox  +  4  q'y”] 

subject  to  Ax  *  b 

Tx  +  ly”^  -  17“  *  C  Ce(Sf  a,  F) 

X  ^  k  Ofj”  ^  0 

i^ere  we  partitioned  the  vectors  q  and  7  of  the  standard  form  (1)  in 
(4^ >q~)  (7^ f7*lf  respectively*  The  fact  that  m  ^  0  (l«et  there 

are  no  constraints  of  type  Ax  *  b)  does  not  alter  the  charaeterl sties  of 
our  problem* 

Among  all  classes  of  special  oases  of  the  tvo-stage  linear  programs 
under  uneertalntyi  the  "complete"  case  seems  to  cover  the  largest  class  of 
possible  applications*  One  can  think  of  the  vector  x  as  representing  the 
activity  levels  of  a  production  plantf  constrained  by  AxsbfX^O*  T 
is  the  "transformation"  of  these  activity  levels  into  sellable  goods*  x  *  Tx  f 

is  then  the  amount  of  goods  the  producer  decides  to  place  on  a  market  \diere 
the  demandf  f  is  only  known  in  probabili'^*  y^  and  y~  represent  the 
"errors"  the  producer  made  in  estimating  the  demand}  and  q'  are 
penalty  costs  for  making  these  "errors"*  For  InstanoCf  an  inventory  ^rpe 
problem  has  T  «  j  ^  represents  the  unit  shortage  costf  and  q*  the  xinit 
holding  oostf  and  Ax  ^  b  the  capacity,  budget,  technology, •••  constraints* 

It  can  be  shown  that  the  correlations  between  the  do  not  enter  the 
problem}  we  do  not  need  the  independence  of  the  *  Ub  denote  the  marginal 
distribution  functions  by  F^(C^)  i  *  1, **•••,£• 
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Tbt  first  ssetioii  of  tldo  rsport  shows  ths  ssistsiios  of  sn  sqaiml«it 
sspsrsttls  ooBm  profisa  to  (3)  •  In  ths  sseond  ssotion  vs  1st  ths  xsndoa 
mrisbls  C  sssuBs  diffsrtnt  distrlbatiaBS^  sad  vs  dsrivs  ths  oorrsspond- 
laf  sqaivsloBt  oobvsz  progrozs.  flasUyy  vs  sua**^  slf oritha  for 

solviaf  (3)  vhtn  C  hss  s  oontiattoas  distrlbutioB* 


nm 

— — ^ — . 

III.  THE  EQUIVALBIT  SEPARABLE  COn^  PROGRAM  SS 

We  U7  that  a  programdog  la  eoulTOlut  to  another  prngreMring 
problem  if  their  aet  of  optimal  aolutiona  ia  identical.  Let  ua  eonalder 

(4)  Minimise  b(^  =  ox  4  Q(x) 

aubjeet  to  Ax  sb 

x^O 

where 

(5) 

and 

(6)  Q(x,C)  *  (Min  qV  +  q’y'l  -  y*  *  C  -  Tx,  y'*’  ^  0,  y"  ^  0} . 

(7)  Propoaitiont  (4)  ia  equivalent  to  (3). 

I  Bp  (5)  9  definition  of  Q(x)  and  (2)»  the  objective  functiona  of 

(3)  and  (4)  are  identical.  It  sufficea  to  ahow  that  (3)  and  (4)  have  the 

* 

i  aame  aet  of  feeaible  aolutiona. 

i 

1  Since  we  aeek  a  here-end-nov  aolution,  a  solution  to  (3)  is  not  a 

i 

pair  (xiy)*  but  a  vector  x.  Our  decision  y  is  taken  when  the  rtuidom 
event  has  occurred. 

Our  second  stage  problem 

(8)  M.nimiae  +  <l"y" 

subject  to  ly"*^  -  ly”  =  C  -  Tx 
^  0  y‘  i  0 
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is  always  feasibltf  vhatsver  be  the  valiies  tssuned  by  and  x;  it  is 
always  possible  to  e3q)ress  any  munber  as  the  diffenenoe  of  two  non-negative 
numbers*  The  constraints  linitix^  the  here-and-nofw  decision  aret  Ax  ^  b  | 

X  2  0  9  l*e*  (3)  and  (4)  bave  the  sane  set  of  feasible  solutions*  If  C3)  is 
(in) feasible  so  is  (4)  end  vice  versa* 

The  word  complete .  which  was  used  to  define  the  class  of  linear  programs 
under  uncertainty  of  the  form  (3)»  can  now  be  justified  by  the  properties  of 
the  solution  set)  vis*  i  every  x  satisfying  the  "fixed"  constrelntst 
(Ax=b)X^O)  is  automatically  a  feasible  solution  to  problem  (3)*  This 
is  not  the  case  in  general  for  linear  programs  under  uncertainty* 

Let 

Ks(x|Ax«b)  x^o). 

If  K  s  gf  lie  define  Min  s(x)  ^ 

xsK 

(10)  Propositiont  (4)  is  a  convex  program* 

Since  K  is  a  convex  set  and  ox  is  a  linear  function  of  x )  it 
suffices  to  show  that  Q^x)  is  convex  in  x  •  It  is  easy  to  verify  that 
Q(X)0  is  convex  in  x  (see  (6))*  The  operator  applied  to  Q(X)0  ) 
KtSp  forms  a  positive  weighted  linear  combination  of  convex  functions  in  x  * 
The  resulting  function  Q(x)  is  thus  convex* 

In  what  follows)  we  assume  that  (3)  is  solvable)  i*e*  z(x)  attains  its 
minimum  on  K  •  Vfe  also  assume  that  K  has  a  non-empty  interior*'^  Us  now 
show  that  the  £q\iivalent  Convex  Programming  problem  (4)  is  a  Separable  Convex 
Programming  Problem  1 2)  p*  482]  and  thiS)  contrary  to  the  assertion  found 
in  the  Appendix  to  [4*  P*  216]  • 
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The  second  pert  of  this  section  describes  some  useful 
chsracteri sties  of  the  objective  function  of  (4)*  The  last  pert  Is 
devoted  to  show  how  the  existing  solution  methods  for  separable  convex 
programs  could  be  used. 

A.  Q(y)  Is  separable. 

Let 

Xi  =  T^x  where  T^  Is  the  1^  row  of  T 

and 

Q(x)  =  when  x  =  Tx. 


None  the  lesSf  we  should  not  confuse  Q(x)  end  Q(x).  Their  domains 
being  subsets  of  R™  and  ,  respectively. 


If  the  function  Q(x)  can  be  written  in  the  form 


Q(x) 


where 


1=1 


Ql(Xi)  is  a  convex  function 


and 


x  =  (Xl . ,Xj) 


then  Q(x)  is  called  convex-separable , 

For  a  selected  x  (i.e.  x)  end  given  K  »  the  problem  to  be  solved 


in  the  second  stage  isi 
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m  m 

(11)  P(X»C)  =  Mlnlmim  ^  Vi 

•ubject  to  -  y^^  = 

i 

^  0  y^  ^  0 

The  dual  to  the  lln«ir  program  (11)  isi 

m 

(12)  Q(x»0  =  Maxlmm 

1=1 

subject  to  -q^  ^  n^(5^,Xj^)  ^  qj  1  =  l,...,m 

We  have  already  seen  that  for  any  given  pair  (x>  O  >  problem  (11)  is 
always  feasiblei  problem  (12)  is  feasible  iff  Vi  the  interval  [-q^»q^]  /  • 

These  last  conditions  are  completely  independent  of  the  values  assumed 
X  end  (  •  Using  the  Existence  Theorem  (duality  theory  in  linear  program¬ 
ming)  ,  we  establish  the  following t 

(13)  Proposition:  (11)  is  solvable  iff  q^  +  q"  =  q  >  0  . 

The  permanent  (Vx»  V()  feasibility  of  (11)  and  the  proposition  we 
just  established  implies  that  if  the  assumption  q^  +  q"  ^  0  was  not 
satisfied,  then 

P(x»  5)  =  -®  VC  ,  Vx  ( Vx) 


E5{p(x,  0 


VX 
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and 

z(x)  =  -  •  V  X  «  K  . 

Let 

(14)  ^1^  =  Maximum 

subject  to  -q“  ^  X^)  1 

i 

(15)  Propositi  on  t  Q(x,  t)  *  ^  * 

1=1 

The  optima]  solution  to  (14)9  and  so  to  (12)  can  be  obtained  es  follovsi 
If  (*»i”Xj^)  <  0|  set  tt^(^£»  Xj^)  =  -q^  !•©•  the  coefficient  of  the 

objective  function  is  negative,  we  set  TT^(^j^»  at  its  lowest  possible 
value  because  we  are  maximizing. 

If  (?!  -  Xj^)  >  0i  set  Xj)  =  qj  • 

*  Xj^)  =  Of  "take  for  TT^(^^f  Xj^)  any  value  of  the  interval  [-q^,  q^]  . 

Let 

TTi(Xi)  =  {optimal  X^) ) 

be  the  expected  value  of  the  optimal  solution  to  (14)  •  If  has  a 
continuous  density  function,  then  tt^(x^)  Is  unique,  but  not  If  Prob  X^)  >  0. 
By  definition  we  set  tt^(Xj^)  =  -q^  when  (JJ^^  -  X^^)  =  0  f  tut  we  come  back  to 
this  problem  in  the  last  section  (IV). 

In  what  follows  we  assume  that  q"*^  +  q~  =  q  ^  0  otherwise  our  problem 
would  be  without  interest.  If  we  assume  that  the  second  stage  problem  is 
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bounded^  then  the  optiml  aolutloQ  to  (11)  auet  eatlefy  the  condition 

s  0  (l*e.  >  0  -•  =  0  end  y”  >  0  -•  y^  =  O) .  One  could  then 

show  that  Q(x)  la  conrex  Iff  q  ^  0  >  using  e.g.  the  property  that  a  function 
Ql(Xi)  is  convex  iff  it  has  non-decreasing  first  differences  and  that  Q(x) 
is  a  convex  combination  of  convex  fVinotiona* 

Let 

T»(x)  =  . ftt^Cxj)) 

Qi(x)  =  {9i(Xi.  ?i)) 

Q(x)  =  EjCQCxi  E) J  • 

Since  the  esqpectatlon  of  a  sum  of  random  variables  equals  the  sum  of  the 
expectation  of  these  random  variables  and  using  (15)  we  have 

m 

(16)  Proposition  t  Q(x)  *  2  ^i^^l^ 

i=l 


Since  the  different  Qj^(Xj^)  sre  convex,  we  have  now  proved  the  separability 
0^*  Q(x)  •  PPom  the  duality  theory  for  linear  programming,  we  also  get 

P(x»  ?)  =  Q(x>  V  given  pair  x  end  K  , 

then 

p(x)  =  E^lPCx,  0)  =  E^CQCx,  0 )  =  Q(x)  . 


B,  A  Study  of  Q^(Xi)  • 

We  point  out  some  of  the  chare cteri sties  of  the  functions  Qj^CXj^)  *  which 
are  useful  to  simplify  the  computation  procedures  when  seeking  en  optimal 
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solution  f'nd  also  to  obtain  explicit  forms  for  the  equivelent  convex 
progrenuning  problem  when  the  's  have  some  specific  di  stribution 
functions* 

By  definition 

"iCxi)  =  ^ Xi 

(17) 

where 

~  +  - 
Qi  =  +  qi 

V 

is  the  distribution  function  of  • 

Also 

Ql(Xi)  =  H,'/*  «i-Xi)dF^(tl)  +  <  /  (Cl-Xi)dFi(5i) 

“hh-^if.  .  .  xidFiC?!)]. 

'i  S  Xi  ^  'i  ^  ^i  ^ 

We  write 

9i(Xi)  =  4^1- '•'i(Xi)  -  "i(Xi)Xi 


(18) 
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where 


(19)  =  qj/  C,  dF,  (C,) 

"  ^1  S  Xi 


then 


m  ni  ni 

9(x)  '2  ■"  ’‘^1 

1«1  i*si  l5i  *•  -* 


In  order  to  obtain  a  more  explicit  form  of  Q^{Xj^)  we  divide  the  range 
in  three  parts,  (-  •,  a^)  ,  [a^,  ],  (p^,  +  ®)  and  we  express  Q, 

for  these  intervals*  If  has  no  lower  bound,  we  set  ®  and 

consider  the  first  interval  empty,  if  has  no  upper  bound  we  set  p, 
and  the  third  interval  is  then  empty* 

Case  1*  “th®!! 

In  this  region* 
njCXi)  =  % 

*l(x^)  =  0 

Qi(xi)  =  q^?i- 

and 

dx^  9i(xi)  =  -q^ 

=  -tT^(Xi) 


on  ( -  ®  ,  cr^) 
on  ( -  ®  ,  or^)  • 


of 

(x^) 

=  +  ® 


wiMir- 


1 
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Thus,  the  function  Q^(x^)  !•  linear  on  the  Interrml  (  -  •#  or^)  •  As 

mentioned  shore,  this  Interval  nsj  be  en^ty*  (See  Appendix  I)  • 

QBSS.  3^  then  ^  x^)  =  I  ^  ^  X^)  • 

In  this  region 

^i(Xi)  = 

^  fW  ^ 


^  a. 


9l(Xi)  = 


+  -►  + 
ll^l-qiXi 


S 

■  V 


(q-Xi)dF^(?^)  . 


on 


The  "form"  of  the  function  on  tills  Interval  [cr^,  P^]  depends 

dFi(?l)  .  In  Section  III  of  this  report,  we  glre  exMaples  for  a  few  common 
distributions*  If  is  differentiable  on  this  interval,  we  havei 


^  •'O. 


on  {a^p  p^) 


»  -  '»i{Xi) 

Case  3.  Xi  >  3^  then  |  <  x^I« 

In  this  regi-in 

n^(Xj^)  =  'll  “ 


on  (a^,  Pj^) 


♦iCxi)  = 


Qi(Xi)  =  <4^1  -  qjxj^ 


f 


u 

«nd 

^9l(Xi)=qJ  onOj, +-) 

-  "^(Xi)  onOj^,  +»). 

The  function  Qj^(Xj^)  i*  thus  linear  on  the  Interral  +*)  • 

(?0)  Propositi oni  Q^(Xj^)  is  continuous* 

% 

If  As  a  continuous  distribution  function,  It  is  obvious  to 

remark  that  Qj^(Xj^)  As  continuous  at  all  interior  points  of  the  Intervals 
(-•»cif^]#  [a^i  +  •  Since  Prob  {  )  =  Prob{K^  =  p^)  =  0,  Q^(Xj^) 

also  continuous  at  or^  and  P^*  It  suffices  to  shov  that  Qj^(Xj^)  As 
continuous  for  equal  to  a  discontinuity  point  of  •  Without 

loss  of  generality,  ve  can  assume  that  Prob(Kj^  =  or^}  =  f  >  0  * 

When  Xj  converges  to  from  the  left,  we  havei 

11*  QiCxi)  “  4“i  • 

When  Xj^  converges  to  from  tne  right,  we  havei 

11m  Qj^(Xi)  =  lAm  ^ X^  -  /*  ‘  Xi)dF^(C^) 

Xi-OTi  Xi-a^ 

—  X 

=  <4^1  -  q!«i  -  11"  5,  f  (?.  -  X.)  !?,(?,) 

1  1  »j 

"k'i*  ‘>l''l 
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Since  the  two  limits  are  equal,  Is  continuous  at  • 

The  following  figure  gives  the  general  form  of  Qj^(x^)  where  we 
assumed  that  discontinuities  for  equal  to  or^,  3^,  k  . 


Figure  I 


(21)  Proposition!  If  a  continuous  distribution  function,  then 

(3l(Xi)  is  differentiable  and 


^Qi(Xi)  =  -n^(Xi) 


on  R  . 
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Since  is  continuous,  then  the  derive tive  is  well  determined  at 

nil  interior  points  of  (-  «,  a^],  [or^,  [3^,  +®)  .  Moreover, 

is  continuous  and  at  and  ,  the  left  and  the  right  hand  derivatives 


are  equal.  This  determines 


Qi(Xi) 


at  and  uniquely. 


The  figure  below  indicates  the  general  form  of  when 


is  a  continuous  distribution  function. 


Figure  II 

In  wn,at  follows,  we  assume  that  or^  >  -  (in  the  Appendix  I,  we  give 
the  necessary  modifications  when  does  not  exist.) 
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•!> 


Let 

Xi  =  ^1  -  +  X^2  ^13 

with 

0  1  ^  Xii 

0  ^  Xi2  1  @1  -  “i 
0^Xi3 

This  yields: 

TiX  +  -  Xi2  1  =  1» . 

We  set 

Qi(Xii»  Xi2*  ^13^  " 

then 

(22)  ^i^^il*  ^i2*  X13)  =  Xj^  +  qj  X13  +  i^Cxia) 

subject  to  "  ®i  ^  ^il 

0  1  Xi2  ^  @1  -  »i 

0^Xi3 

Where 

(23)  Ui(Xi2)  =  -%  Xi2  +  5i  tXi2  -  «i)dFi(4i) 

0 


and 


F^l^i)  =  F^CCj  +  o,j) 


since  the  first  term  linenr,  q ^  0  pnd 


f. 


^12 


A 

(Xi2  “  is  convex,  so  is  (over  its  domeln). 


The  two  first  terms  of  ^12*  '^13^  represents  the  linear  sections  of 

Qi(Xi)  t  see  Figure  !•  The  term  gives  to  the  function  its  particular 

character,  which  depends  on  dF^(4^)  .  As  we  shall  see  in  III  , 
be  a  piece-wise  linear  function,  a  qtiadratic  function,  and  so  on.  Let  us 
also  remark  that  the  function  ^12'  ^13^  convex-separable,  the 

equivalent  convex  programming  problem  to  (3),  in  terms  of  x^,  x^^*  ^12*  ^13 
is  thus  a  separable  convex  prcgrammlng  problem,  linear  in  x^,  x^^.*  ^13  • 


reads  I 

(24) 


n 


m 


m 


liininlze  z 


=  2®  ^  ^1  ^13  ^  “^2 

j=l  ■ 


i»l 


siib.iect  to 


,x. 


in 


1=1 

“  bj  i  —  l,»..,m 


J=1 

n 

2  ^ij^l  ’^il  ”  ^i3  ■  ^12  ”  ^i 

J=1 


i-  ^ 


0  ^  * j  I  ^  ^  Xj^2  »  0  ^  X^2  —  ~ 


C.  Separable  Convex  Programming  Algorithms 

Two  basic  references  in  this  are?  are  [2,  pp.  482-490]  and  [5,  pp.  89-100]. 
In  his  book  [2],  Dantzig  suggests  two  approaches  to  these  problemsi  the 
bounded-variable  method  (or  broken  line  fit)  and  the  variable-coefficient  method. 
A  broken  line  fit  to  the  's  would  reduce  our  problem  (24)  to  a  large 

linear  program  (the  number  of  variables  with  bounds  would  Increase).  This  is 
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equivalent  to  the  assumption  that  the  distribution  of  can  be  approximated 

byi  or  l3|  p  discrete  distribution,  taking  on  positive  probability  at 

the  points  where  there  is  r  change  in  the  slope  of  the  broken  line  fit.  iiro  in,  A* 


If  one  uses  the  variable  coefficient  approach  one  should  take  advantage 
of  the  feet  that  (24)  is  a  linear  progremmlng  problem,  but  for  Xj  2  » 
l=l,...,m.  The  problem  then  becomes* 


(25) 


Minimize 


n  m  m 


subject  to 


n 


2 

j=i 


a.  .X. 

ij  J 


”  b »  1  “I,***,!!! 


n 


and 


2^ij*j  ^il  “  ^13  “  ^12 


J=1 


42  4"i 


•H 

II 

i^l,**.. 

II 

0 

i  ®1,**», 

=  1 

1  =  1,  • . . , 

0 


ra 


The  solution  method  to  this  class  of  problems  ?s  well  as  the  convergence  properties 
are  fully  discussed  in  [2,  pp.  486-490,  pp.  433-438]. 
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HI.  THE  PROBABILITY  SPACE  I  (I,  3,  F) 

In  this  section  we  derive  the  equivalent  convex  programming  problem  to 
(3)»  for  some  specific  distribution  functions  F  .  Up  to  now,  the  assumption 
made  on  the  distribution  of  were  limited  toi  E{K^)  exists  and  one  can 

compute  the  value  of  f  (x^P -  tpdF^( ,  Vx^p  c  fO,  3^ -cr.  ]  if 

/Xi 

-  X^)dF^( , 

1 

V  Xi  c  i.e.  the  formilas  of  the  Rieman-Stieltjes  integration  by 

parts  apply)  •  We  did  not  require  the  independence  of  the  , 


A.  T  l3  finite. 

The  notations  used  in  this  paragraph  differ  slightly  from  the  previous 
section. 


12  1 

Let  ^  .  ^  ^i  values  assumed  by  with  probabilities 

12  ^i 

f^  ,  f^,....,f^  resp^^ctively. 


Let 


f^  =  Prob 


k.+l 

^  =  1  =  Prob  ,  PY  =  Prob  {r.  ^  =  0 
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It  Is  ef'sy  to  see  that 


{Min  +  q“y“  1  5®  ^ 


I-  s+1 


Then 


9i(Xi) 


=  ’I'l'S'’!  ■ 


i=l 


where 


j. 

? 

X^l 


1  ^  rl 

Xi  1  «i 


=  d] 


0  ^  xf  ^  -  cf'^  =  df  =  2,...,k, 

k  +1 

0  <  Xi 


Since  qi  >  0  (the  second  stage  problem  is  bounded  by  assumption)  and 

for 

it  is  readily  seen  that  Qi(Xi)  Is  a  piece-wise  linear  conyex  function. 
This  last  property  allows  us  to  formulate  our  original  problem  as  a  linear 
program  [2,  pp.  484-485],  vlz.i 


n 


-  k.+l 
m  1 


m 


(26) 


Minimize  z  = 


2  vj-2 

J=1  1=1  721 
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subject  to 


—  f  •  #  •  I 


-  2 


X.  20  , 

11  HI  k,4l 

Xi  ^  dj  ,  0  ^  xf  ^  df  .  0  1  x/ 


j-l,...in 


li  -i 


I**!  f  %  •  •  ^in  end  X**~2|  •  •  •  | ^ 


where  i®  ®  constant. 


-  Xj^2.  corresponds  to  and  X^^  iii  (24)  corresponds  to 

k.+l  , 

.  The  variables  x^  »  4=2, ...jk^  in  (26)  correspond  to  the  unique 
vnrifible  x^2  (24)  • 

This  problem  can  now  be  solved  using  e  linear  programming  code  with 
upper-bound  variable  option. 


1.  Allocation  of  Aircraft  to  Routes  under  Uncertain  Demand 


The  approach  indicated  above  could  be  attributed  to  Ferguson  and  Dantzig 
where  it  was  underlying  their  works  "allocation  of  Aircraft  to  Routes  under 
Uncertain  Demand."  [2,  pp.  568-591].  Using  their  nota  tion,  the  problem 
written  in  standard  form  (3)  ist 


Minimize 


.  m-1  n-1 


p.  .k . )  X.  ,  4  ^vc  .X  .  4  k  .y . 

:  Ij  ^  mj  mj  >  j-'j 
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n 


subject  to 


2^ 

j=i 


^ij 


=  6. 


i”l  y  •  •  •  jin-l 


m-1 


Spifij  "  \3  - 


=  { 


1-1 


j-1 j  •  •  • »n-l 


i— 1  j •  •  •  I iD-l  f  j—l>*»«|n 


where  7.  is  the  number  of  seets  remaining  eTailable  end  K.  here  is  their 

J  J 

dj  •  The  Interpretation  of  the  other  symbols  is  given  in  [2f  pp*  574]  • 

This  problem  hj'S  the  following  featurest 


c  ,  =  0 

mj 


for  all  j 

In  our  formulation  this  merns  =  0 

- 


i.e.  • 

In  their  terms  -F^  q“  =  -kj{F^)  =  -kj(l  -  Yj^j) 
p^^.  ^0  implies  2  0.  i«e.  ^  0  for  all  j  •  The  random 

k 


variable  4 


J 


12  “I 

on  values  K,  <  ^ . <  and  it  is  assumed  thati 

,  j  J  J 

m-1 

jc  . 


2pijX,.<5/  for  all  J 


j=l 


i.e,  Xi 


kj.i 


is  fixed  at  value  zero,  Taking  these 


modifications  into  account,  the  linear  program,  corresponding  to  our  gener-  1 
form  (26)  follows t 

V 

n-1 


J 


m-1  n-1 

2  2  ^  2“^  -4i  '  “0 

1=1  1=1  J=1  M 


xf  +  R, 


(27)  Min 


24 


n 

ffabject  to 

1=1 


m-1 


1=1 


1**1 1  •  • « ^ni— 1 


=  0 


^  ^  0  i~l I •  •  •  y ni-1  f  j  —  l^***yn 

'*  s 

0  Xj  —  j=li*»«jn  and  ii=lj»..jk^ 

l,e.  cost  (negative  profit)  of  flying 
fircrrft  type  i  on  route  j  et  full 
capt-city* 

d*  is  defined  es  above* 

J 

There  the  first  n  x  m  columns  of  the  constraints  matrix  (matrices  A 
and  T  in  our  standard  form  (3)  have  the  structure  of  a  weighted  distribution 
problem,  Ferguson  and  Dantzig  specialized  the  upper-boixnd  algorithm  for  linear 
programs  to  this  class  of  problems  which  lead  to  an  elegant  solution  technique, 
taking  full  advantage  of  the  nature  of  the  problem*  We  would  like  to  point 
out  a  slight  conceptual  difference  between  Ferguson  and  Dantzig 's  formulation 
[2,  p*  577]  and  ours,  reflected  in  the  objective  functions.  The  Ferguson- 
Dantzig  jbjective  form  can  be  interpreted  rs  followsi  only  the  costs  of 


vnere 


n-1 


=  2 


'-“'J 


J=i 


and 
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flying  f  irplane  type  i  on  route  j  are  certain  (Cj  ,■)  end  one  expects 
a  certain  revenue  obtained  when  filling  up  the  seat  capacities  made  evuilablei 
where  our  objective  reads  as  follows*  profit  flying  aircraft  type 

i  on  route  j  are  certain  and  one  expects  only  a  lost  revenue  resulting 
from  not  filling  the  seat-capacity  made  available.  Obviously,  both  object¬ 
ives  yield  the  same  vslues  for  the  optimal  *s  and  we  can  derive  one 

from  the  other. 

2.  Elmaghraby*3  Approach 

The  problem  studied  by  Elmaghraby  in  "An  Approach  to  Linear  Programming 
under  Uncertainty,"  [4],  written  in  standard  form,  is  ns  follows* 


Minimize 


z  =  E^{cx  +  qV  +  q'y”3 


subject  to 


Ax 


<  b 


then 


Ix  ly  -  ly"  =  K 
x>0y'*^>0y”>0 

(i=l,...,m  =  n)  and  one  c;-n  speek  of  the  objective  function 


n 


n 


z  =  cx  +  Q(x)  =  cx  4  Q(x)  =  ^c,x^  +  2q^(Xj) 

j=l  '  j=l 

as  a  separable  convex  function  in  x,  rather  thaii  x  and  x  before  (24), 
but  this  does  not  lead  to  noticeable  computational  simplifications. 

In  what  follows  we  present  Elrnfighraby 's  version  of  the  linear  program 
used  to  solve  his  problem  which  will  obtain  its  solution  by  a  "sequence"  of 
linear  programs  (by  this  he  me?  ns  th/ 1  Q.(x,)  can  be  broken  up  in  linear 

«]  V 
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sections  end  the  simplex  method  will  exemine  these  different  lineer 
sections  in  ’’sequence")  . 


k,+l 
n  j 


Minimize  z  = 


2 


r  ~  1 


J=1  i=3 


sabj*5Ct  to 


(k  ,  +  l  y 
i=l  / 


—  i— 1 f • • 


•  i  m 


s . 


xj^O 


k.+l 
J 


where  x 


x=i 


j=l,...,n;  £=l,...,k^+l 


J 


If  xj  la  the  optime  1  solution  to  the  problem  then  x^  =  2 

j=i 


optii»-l  for  his  original  problem.  It  is  obvious  that  the  inequelities 
s 


3 

2  ^  'j 


£ 

ccMld  have  been  used  to  obtein  upper-bounds  for  x  as  was 

J 


i=l 


Q 

done  for  in  (26).  This  reduces  the  size  of  the  problem  considerably. 


3»  El-Agizy's  Approach 

An  alternate  method  to  reduce  problem  (3)  to  the  linear  programming 
problem  (26)  is  given  in  El-Agizy  [3]*  This  derivation  gives  also  an 
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alternative  proof  that  the  assumption  of  Independence  of  the 
superfluous. 

B.  is  uniform,  V  1 


Let 


If  «  [a^,  3^] 


=  0 


otherwi se 


then 


f,(5l) 


_  1 


^i-^i 


if  [0,3^  -  cr^] 


=  0 


and  by  (23) 


otherwise 


4^12  3^-a, 


^i  +  ^i  2 

Jq  ^^i2”^i^^^i"  "^1^12 2(3^^^)  ^i2 


(24)  become.: 


(23)  Minimize  z  = 


n 


m 


m 


^  2  ‘  Vi3^  2  2  3,-<y 

J=1  1=1  "  ^  ^ 


^12 


n 


2 


j=i 


ij  j 


^  b,  i""lf  •  •  •  fXH 


u 

2 

j=i 


^i:^j  ^il  "  ^12  ■  ^  i-l,...,m 


^i3 


C  <  X.-  »  ^  »  0  <  Xi2  -  ^i"®!'  °  ^  ^ 


i3 


subject  to 
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(28)  is  easily  recognizable  as  a  Quadratic  Programming  Problem  for  which 
many  algorithms  exist  in  the  literature,  e*g.  see  [2,  pp.  490-497].  Beale 
was  the  first  one  to  point  out  this  property  for  uniform  distribution  [  l] . 


C.  K.  is  exponential,  V  i 


Let 


=  \^e 


“\^i 


if  K.  c  [0,  +  *] 


=  0 


otherwise 


then 


fl«l)  =  , 


'i  =  i 


and  by  (23) 


•'o 


^i  ^i2"  ®  ^ 


using  Taylor’s  expansion 


=  qiX^2 


2,2  • 

^i2^ 


. .  ^  ^  11  •  n 

n=3 


^^i2 


^l\  2 


n 


r  Xi'z  +  5i  2  -ir 

n=3 


an  ppproximr tlon  to 


~  4.  51^  2 
-  "9iXi2  2  ^12 
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The  value  of  this  approximation  depends  on  the  relative  value  of  ^  and 

-  1 

the  proximity  of  the  optimal  value  of  x^2  ^i  ”  ”  *  introduce 

the  approximation  of  objective  function  of  (24) »  the 

resulting  equivalent  convex  programming  problem  ist 


subject  to 


/-I 


2Vj^’'u'’'12  =1 

J=1 

°  ^  \  ^  °  ^  ^i2  • 


1^1 y • • • y  m 


i^ly • • • ym 


So  as  (28)  this  is  a  Quadratic  Programming  Problem  (  V  iy  q^X.  >  O) . 
Remark  that  we  did  not  introduce  »  because  =  +  ®  >  i»e»  hr  s 

no  upper  bound* 


D. 


5  has  a  continuous  distribution  functiony 


VI 


In  our  last  paragraph  ( III.C)  we  "accepted”  an  approximation  to  the 
objective  function  in  order  to  reduce  (24)  -  the  equivalent  convex  program¬ 
ming  to  (3)  -  to  a  quadratic  programming  problem  for  which  algorithms  have 
been  developed*  The  purpose  ^f  this  paragraph  is  to  suggest  approximation 
for  the  distribution  functions  -nd  then  show  that  the  so  obtained  "equivrlent" 
convex  programming  problem  is  in  a  form  for  which  efficient  comput?  tional 


30 


Mthods  exist* 

We  have  already  pointed  out  In  Section  II«C  (on  Separable  Convex 
Programming)  that  replacing  by  a  broken  line  fit  is  equivalent 

to  finding  a  discrete  distribution  which  would  "approximate",  in  some 
sense,  the  distribution  of  the  random  variable  K •  Here,  ve  approximate 
continuous  distribution  by  step-functions*  In  other  words,  we  replace 
the  random  variable  by  weighted  sua  of  random  variables  having 
uniform  distributions* 


where 


i=i,  *..,k^  are  uniform  density  functions* 


In  (24)j  replace  the  constraint 


^11  ‘  ^12  “  ^i3  "  ^i 


by  equations  of  the  form 

n 

2  ^ij*J  ^il^  "  hi  "  ^13  '  ^1 


Z  —  1,  •  •  •  f  k 


i* 


The  objective  function  of  (24)  becomes 
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z  = 


2 

j=i 


m 


m 


c  .X.  + 

J  J 


Pllq^Xii  +  q^X^j)  ^ 


'Pl  • 


«  ^  i 

We  have  p.lready  shown  ( III.  C)  that  if  is  uniform  then 


linear  and  a  quadratic  term.  See  (2C).  Then 

k. 


m 


k. 

m  i 


z  = 


This  approximation  of  random  variables  having  continuous  distribution  by  the 

sum  of  random  variables  having  uniform  distributions  led  also  to  a  Quadratic 

m 

Programming  Problem*  It  is  clear  th?;t  the  increase  in  size  (3  m  J  (  k.  - 1  ) 

i=l 

m 

nev  variables  of  which  2m  J  (k, -l)  are  bounded  and  (k. -l)m  additional 

i^l  ^ 

constraints)  depends  on  the  des.red  q  ality  of  the  ep.proximation*  To  find 

XX  X 

the  a*  and  3^  ,  lower  and  upper  bounds  for  ,  see  the  Appendix  to  [l] 


E.  Summary 

This  section  has  shown  that  either  directly  or  by  approximation  it  Wf  s 
sometimes  possible  t:  reduce  the  equivalent  convex  programming  to  (3),  to 
programming  problems  f  u-  »'hlch  we  possess  efficient  aigorithmz#  For  sln^llc- 
ity  we  have  assumed  in  er^ch  paragraph  thrt  the  margin.'!  density  function 
was  of  the  S' me  nature  Vi*  This  is  not  necessarily  the  case*  It  should  be 
clear  by  now  that  each  tre' ted  independently.  For  instance, 

if  has  •  discrete  distributl  :)n,  '^nd  sa.y  a  uniform  distribution  it  is 

not  difficult  to  snow  tn.  t  toe  equivalent  c  onvex  pr  jgrcr:  .-Ung  problem  is  a 
quadratic  programming  problem* 
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IV.  ;jj  ALGORITHM  FOR  CfliTINUa’S  DISTRIBUTION  FUIICTIGiS 

We  now  give  an  algorithm  to  solve  problem  (3)  when  p  is 

a  continuous  distribution  function.  We  assume  that  the  distribution 

functions  allow  Rienan-Stieltjes  integration  of  linear 

functions  of  .  We  also  assume  that  (3)  is  solvable  which  implies  among 
other  conditions  that  q  ^  0.  We  have  shown  (4)  that  the  equivalent  convex 
programming  to  (3)  can  be  written 


(30) 


or 

(30') 


Minimize  2(x)  =  cx  +  Q(x) 


subject  to 

Ax 

=  b 

X 

IV 

o 

Minimize  z(x,x) 

=  cx  +  Q(x) 

Ax 

=  b 

Tx  -  X 

=  0 

X  ^  0 


where 


then 


m  m 

Q{x)  =  °  2  ['’l 

m  m 

Q(3t)  =  2^1  ^i  “  2  n^(Tj^x)T^xl  . 

1=1  S  ^  J 


Since  Is  a  consteuit,  we  nty  delete  this  term  from  the  objective 

m 

function  of  cur  problems.  We  also  wr  ^(x)  =  • 

i=l 
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Problem  (30)  becomes 


(31) 


n  m 

Minimize  z(x)  =  2  C^X^.  -  2  I  tl*^(T^x)  +  n^(T^x)T^x  I 

1^  i=l  •* 


n 


subject  to 


a. .X.  =  b 

ij  J 


x^2  0 


1~1|  •  •  •  f  in 


j=l, . ,n 


We  should  note  thatt 


Iffl(Ci)  is  continuous  et  i  then 

"iCXj)  =  <li  -  iFj(Cj)  =  f  ■ 


Cl<Xi 


'«!<  Xj 


If  >  0  for  5j  =  Xj  then  f  dFj(?j) 


tl<Xj 


'I 


dF^(5^) 


1^  Xi 


and  q.  - 


1  -  ’i  fr.  ^  ^  'll  -  5i  jf  . 


)  . 


In  this  case  a  complete  range  of  values  exist  for  the  expected  values 
of  optimal  solutions  to  (14).  Identical  relations  hold  for  • 

In  what  follows,  we  assume  that  is  a  continuous  distribution, 

V  i=l,.,.,me  The  following  propositions  enable  us  to  derive  an  '  Igorithm 
to  solve  problem  (31)  >  and  consequently  problem  (3). 
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(32)  Propositi ont  ^  z(x)  =  c  -  n(x)  T  (l.e.  =  c^.  -  jrr  (x)  T j  ,  )  . 

The  result  Is  Immediate  if  we  remftrk  tlv  t  (21)  yields  ^  Q(x)  =  -''^  (x) 
and  also  that  x  “  T  x  . 


(33)  Propositi ont  -n(7)Tj  X  -  ^(y)  is  e  supporting  hyperplane  of 
z(x)  at  X  =  7  where  x  ”  T  7  . 

In  view  of  (32),  it  suffices  to  show  that  z(50  =  -n(x)Tjx  -  v(y) 
which  is  obvious  by  the  definitions  of  ^(x)  . 

(34)  Propositi  ont  If  -n  (j^  T  J  (x  -  x)  >0,  VxeK  then  z(x)  has; 
minimum  at  x  • 

Since  z(x)  is  convex,  then  the  following  inequality  holds  [7]  : 


z(x)  -z(X)  >  Jc-TT(x)Tj  (x-x)  . 


Moreover,  by  hypothesis  the  second  tenn  of  this  inequality  is  n  )n-negf  tive 
for  all  x«K  .  This  implies 

z(x)  2  z(x)  VxeK. 


(35)  Propositi  on  I  Let  x,  xeK  and  such  that  jc  -n(x)Tj  x  >  -n(x)T  j 

then  3  X*  €(x,  x]  such  that  z(x')  <  z(x) , 

Since  |c  -tt(x)tJx  >  ^c  -n(x)Tj  x  ,  we  have 
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-tt(x)tJx  >  Jc  -n(x)Tj  (X  X  +  (1  -X)x)  VXc(0,l] 

If  z(x)  ^S(Xx+  (1-X)3c)  VXc  [0,1]  »  consider 

5(X)  =  i(\x  +  {1-X)x)  where  X*[0,  1]. 

Since  z(x)  Is  differentiable,  sols  C{X)  [6]  •  Then 

^  t(X)  =  [c  -n  (x)  T]  (x-x)  >  0  . 

This  implies  ttet  JX*  c  [0, 1)  such  that 

C(X*)  <  Cd)  . 


Let 


X*  =  X*  x+  (1 -X*)x  we  have  z(x')  <  z(x)  which  c:ntrrdictj 


z(x)  ^  z(X  X  +  (1  -^)x)  ,  VX  «  [0,  l] 


(36)  ProDosiUoni  Let  xeK  and  2(x)  >  z(x*)  =  MiniTun  z(x),  then 

X  c  K 


ax  such  that  [c-n(x)TJx  >  [c-n(x)T]x. 

Since  z(x)  is  convex  and  by  our  hypothesis  we  have 
0  >  z(x*)  -  z(x)  ^  [c-n(x)T]  (x*-x)  . 

The  last  two  propositions  suggest  an  iterative  procedure,  the  next  prop  s!t1 
gives  us  a  test  of  optlmBllty. 

(37)  ProDositioni  z(x*)  =  Mlnlnum  z(x)  iff 

xeK 

[c -n(x*)T]x’  =  Minimim  fc -n{x*)T]x  where  x* 

xsK 


^  iX  • 


Let  [c  -  tt(x  *)  T]x*  <  [c -tt(x*)t]x  V  x  eK  then  by  (34)  x"  is  ptiml. 
Let  2(x*)  ^  z(x)  Vx  cK  and  ?  sione  that  3x  eK  such  that 

[c-n(x“)Tjx“  >[c-n(x°)T]x 

then  by  pr^r  :)sition  (35),  3  xe(x°,x]  n.ch  that  z(x)  ^  z(x‘’)  ,  which 

contradicts  the  assumption:  3xeK  such  that  [c  -  n(x ')  T]  x*  >  '^c  -  ^(x*)  T]x 

Let  us  now  consider  the  following  linear  programming  problem, 

(33)  Ilinlnize  *^0  -  n(x^) '"]x 


-object  to 


Ax  =  b 

X  d 


where 

It  _  ^  k  k  ^ 

X  =  T  X  ,  X  e  K  . 

Since  problem  (31)  is  solvable,  so  is  pr  blem  (38)  Vx  eK;  (proposition  (?0) 

and  the  linearity  f  the  term  cx  prjves  the  continuity  of  z(x)  ver  K  ). 

k  k 

(37),  ii'  X  is  an  optimal  s  )latl  jn  to  (38),  then  x  is  optimal  for  (31) 

If  X  is  n  ot  an  optimal  soluti  .n,  then  by  (36)  the  optimal  solution  to  (38), 
_  k 

Sf.y  X  ,  in  such  that 

'c  -n(x^)  T](x^  -  x^)  >1 

then  by  (35)  ,  3^^"*^^  c  (x^  ,  ]  such  that 

z(x  )  <  z(x  )  . 


C  K 


we  cen  find 


,  k4l. 

tt(x  ) 


ond  solve  r  new  linear  progr'^m  of  the 


Since  X 
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form  (38)  where  we  introduce  the  new  values  for  the  ro«  vector  ti(x)  .  To 
find  consider  the  funotioni 


(39) 


-  k. 


C(X)  =  z(Xx  +  (1-M  5  ) 


j=i 


Vi(^(xJ  -  xj)+  x5)(^(xj  -  x?)  +  xj)  . 


Since  2(x)  is  differentiable,  so  is  ^(X)  [6].  The  derivative  of  «:(X) 

with  respect  to  X  for  X^  <  X  ^  ^e+1  * 

i 


i-  C  (X)  =  e(.'‘  -  i‘ 


3ni 


1«1  id  p  a 


X(x^x![)+x? 


^2  ^^’^i  ■ 


id. 


i?5(rj 
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nni 


s  s+1 


Vs  =  {1,2,...,  r  ^  2m  +  2]  . 


Ic  “  Ic  \i 

/j'e  ass  .mtd  here  that  -  X  .•  >  0  ,  this  is  n  >t  the  case  V^  ,  we 

levclop  the  derivation  of  ^  C(^)  in  more  detail  in  Appendix  II.  To  find 

the  miniimim  of  ^{\)  we  successively  compute  the  value  o  f  at 

the  points  X.,  (at  most  2m  2)  ,  for  s=l,...,r. 

If  -^^(0)  >  0  then  C(^)  attains  its  minimum  on  ^0,l]  at  X  =  0. 

If  ^  ^  ^^s+l^  -  ^  "^hen  C(^)  attains  its  minimum 


at  some  X  c  X^^^]  . 

If  attains  its  minimum  on  [  ,l]  et  X  =  1  , 

If  C(X)  f. ttr  ins  its  minimum  rt  x  =  1,  then 

z(x)^zix)  Vxt[x,Xj. 

X 

This  implies  that  x  w-' s  en  optimril  solution  to  (38),  otherwise  vre 

it  ic 

contradict,  (36),  thus  x  is  an  optimr-l  solution  to  (31).  Let  X  be  the 

minimum  of  (,{\)  -  z(X  x^  +  (1  -X)x^)  on  ^0,1)  we  set 

k-fl_,.k  k  ,  .k^-k 

X  =  X  X  +  (1  -X  )  X  . 


n  flow  chart  of  this  algorithm  is  given  rt  the  end.  We  now  show  the  convergence 

of  this  process.  Propositions  (35)  and  (36)  assure  us  that  if  x  is  not  an 

k  k  -f  1 

optimrol  solution  for  (31)  »  then  z(x  )  >  z(x  )  since  z(x)  attains  its 

ic  —  K  ic  1 

minimum  milue  on  (x  ,x  ]  at  x  .  M  re  ver,  problem  (31)  being  solvable 
implies  that  the  series  {z(x  )}  is  Cauchy  convergent. 
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(41)  Proposition:  [c -n  (x^)T]  (i’^  -  ^  z(x*)  -  z(x^  wherr 

Is  an  optlmFl  solution  of  (31) • 

z(x)  Is  convex  end  (21)  then 

2(x*)  2  2(x^)  ^  [c-p(x’')T]  (x*  -  x*') 
and  since  x*  Is  optimal  for  (38) »  we  have 


[c-it(x^)T]x*  ^  [c-ti(x  )T]x^. 

wg  up  these  two  Inequalities  gives  the  desired  result.  ?tom  this  last 
proposltlony  we  have  obtained  a  lower  bound  for  z(x  )  and 


(42) 


S(x^)  +  [c-ti(x*)Tl  (x*-  X*)  ^  z(x’)  ^  z(x"’)  . 


=  k  _k^ 


At  each  cycle  of  the  algorithm^  we  could  eoBqrute  z(x  )  +  [c  -tt(x  )T](x  -  x  ) 
and  use  for  lower  bound  of  z(x*)l 


^  =  k  _k» 


We  obtain 


s  Max  |z(x^)  +  [c -ti(x^)t1(x^  -  x^)| 

i=lf ...f k 


-  S(x^)  ^  z(af»)  -  S(x^)  1  0 


t,h«.T<  z(x'*)  -  Lj^  Is  an  upper  bound  on  z(x*)  -  z(3^)  .  This  upper  bound  could 

^  Ic 

be  used  for  stopping  the  eomputatlony  e.g.  when  z(x  )  -  Is  less  than  a 
predetermined  number. 

'  k  -  k  k 

To  show  that  z(x'‘)  ■(x“)  It  suffices  to  show  that  [c  -tt(x  )T](x  -  x  ) 

^  Ic  Ic 

has  a  subsequence  such  that  llm[c-tT(x  ^)T](x  ^  -  x  ^)  •♦0.  If  the  process 
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*  Ic  \c  ^  Ic 

Is  finite,  we  have  x  =  x  ,  Vk  ^  k  Let  us  assume  that  z(x  )  >  z(x‘')  yk , 

then 

(43)  Proppsltlont  d  >  0  such  that  [c  -  n(x^)  T]  (x^  -  5^)  >  D  Vk. 

Let  us  assume  that  3^  ^  0  such  that  [c  -tt(x^)T](x^ -x^)  C(l)  >  Y  k 
then  by  continuity  of  n(x),  see  (20),  and  for  k  ^  k^,  3  (0»l]  such  that 

[c-n(v\^  +  (1 -v^)x^)T](x^-x^)  =  ^  f:(v^)  =  D/2. 

Moreover,  by  convexity  of  z(x),  we  have 

/  kv  /  k  k  ,  kx-k^  V  /,  k«  r  /  k  k  .  kv-k^--/  k  -k. 

z(x  )  -  z(v  X  +  (1-v  )x  )  ^  (1-v  )[c-n(v  x  +  (1-v  )x  )Tj(x  -x  ) 

and  we  also  have 

„/  k  k  .  /-  k.-kx  /  k  +  1-,  V  ^ 
z(vx  +(l-v)x)-z(x  )^0. 

Adding  up  these  two  Inequalities,  we  obtain 

/  k\  /  k+1.  »  /_  k»  r  /  k  k  / -  k\  —  k\  /  k  —  k\  D  / _  k\ 
z(x  )  -  z(x  )  ^  (1  ~v  )  [c  -n(v  X  +  (1  -V  )x  )  T](x  -x  )  =  ^  (1  -  v  ) 

thus 

uuh  -  5(x''^h] 

I^v‘‘^§rz{x‘'"h  -£(*’')]  4  1. 

Since  lz(x  ))  Is  cauchy  convergent,  we  have 

11m  =  1  • 

k  ® 


A-1  •  “■•“iSfK* 


a 


I 


I 


I 

1 

f 

I 

m 

I 


Ue  aso  haves 

I  <  (  fe  -  vix^l]  -  [c  -  n(vV  +  (1  -  v’')  J^T]  J  (x^  -  i**)  ^ 

||[e-s.(x^T]  -  fc-n(v‘'x*'  +  (1  -  v**)  x’‘)T]||  \\x^  -  x^ \\  i 

||[c  -  n(x*^Tl  -  [e  -  iKv^'x^  +  (1  -  v^  x'^T]!!  •  M 

mm  N  ^  Si^*  II  3^  -  II  . 

k 

3ueh  a  M  exlata,  baeauae  (3S)  Is  solvable  V  k ,  and  x^(  V^)  can  be 
ejqiressed  as  a  oomex  eoriblnatlon  of  all  extresK  points  of  K  •  Mco, 

||[c  -  nCx'^T]  -  fe  -  n(v^x’‘  +  (1-  v^)  X^)T]||  tends  to  zero,  as  k  -  . 

(  V  eoBTenges  to  1  and  n(x)  is  eontlnuous).  That  means  that  at  the 

Halt  «e  aist  hare  ^  ^0  p  iihieh  eontradlets  our  assta^stl  on  that 

fe  -  n(x^T](x^  -  x*')  >  D  >  0  ¥k  . 
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Flow-Chart  of  the  Aliforithm 


At.  optlnfcl 
solution  for 
the  llne/ir 
^  progran  J 


Temin?;te 
X  is  t  e 


optirrl  s'^M  - 
tion  for  (3) 


Compete  ^ 

X  =\  X  +  (l-\)  X 


k  -f  1_  ^  k  -f  1 
X  =  ix 


k  +  Iv  +  /• 

>:  )  =  q  /  dF(0 

K>T\^  il 

/d  F  '  0 

k  -i  1 
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David  Kohler  wrote  an  experimental  code  for  this  algorithm.  We  used 
IBM  7094  and  solved  a  few  examples  for  which  the  computing  time  was 
very  reasonable.  An  outline  of  this  code,  its  features,  an  intuitive 
justification  and  examples  are  given  in  [8]. 
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APPE.DIX  I 


We  derive  here  an  explicit  expression  for  {J.  (xJ  when 

1  i. 

lower  bound  •C).  We  recall 

3l(Xi)  =  \ 

where 


E^fq}  =  ?j 


has  no 


'♦lUi) 


/ 


C^dF.(?,) 


We  divide  the  venge  of  "two  parts  ^ nd  derive  explicit  expressions 

f  W^(x^j  on  those  intervals  I 

Cose  !•  x^  ^  then  ^  }  is  the  set  of  integration  for 

and  TT^Uj_J  . 

In  this  region,  we  have 

TTiUj)  =q; 

(X 

Qi(Xj)  =  qj  ?i- 

—  CD 

"f  is  differentiable  on  the  interval  we  have 

i  i  ^ 
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Case  2.  <  X^  then  [X^\f.^ix^]=  Si 

In  this  region 

Tl^Cx^)  =  -qj 

'♦llXi)  = 

Q.^X^)  =  -q[q  +  ^Xi 

and 

g^^Sl^Xj)  =  qj  =  -"i(Xi)  on  (p^,+  •)  . 

The  function  Is  linear  on  . 

Let 

Xi  =  Xij  +  Xi3  with  Xu  <  ej,  0  1  Xi3  TjX  -  Xu  -  x-u  =  0  • 

Let 

then  ^ 

Ql(x^2»^i3^  *  "  '^1^12''’  ^i3  * 

In  a  similar  manner  we  could  have  given  an  expression  for  Q^(Xj_)  when 

has  no  upper  bound  but  this  could  be  obtained  immediately  from  (22), 
by  letting  0^  =  -•  ®  and  deleting  the  term  in 
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AP?n:DTX 


Fr  jm  (39) 


C(\)  =  z(\  x^+  (1  -  \)x^) 


n 


m 


^  X  J)  (^(yj  -  X  5^;  +  x^) 


^  Ic  “  k  ™  iC 

In  order  to  simplify  our  notations,  wc  shall  write  ^(x^  -  X  .•  )  +  X  ^  • 

Let  .3  c  nslder  ^.(xh)  and  n,  (',\)  . 

11  X  I 

If  X^  -  X  0,  then  ^  =  0  ,  we  delete  thosr-  terms. 

Ic  —  k  k  •-  k  ^ 

In  wrat  follows,  let  us  assume  that  X|-Xj>0>  1^*  Xj^-XjI^O  th^ 
inequalities  we  obtain  for  the  regions  of  \  should  be  reversed. 

-  k 


'asf  1.  then  \  £ 


^i  - 
k  -  k 

Xi  -  Xi 


an  1 


V  Xj  )  = 


•J^i(x:)  =  0 


.aXi)  -  9i  -  di  X^ 


d^/Xv_  -^/k  -kv 

w:  -^0 


Case  2.  o',  <  X-  then 

-  i  —  1  -  i 


Of.  -  X 


-  k 


i 


X,  - 


-  k 
X  4 


e.  -  X 


-k 


i  IT 

X, 


-  k 

X, 
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"ilXi) 


q-  -  q, 


/ 


\ 


and 


\v  _  + 


i'Xi)  =  qjxi-  5i  y  ^(i:!  -X^ldF^Cr.) 

“l 


^  -i(Xi)  =  -q^Cxi  -  xj)  ^  qjCxJ  -  x\) iT  (x^) 

•'a . 


Case  3.  ^  then 


3^  -  xl^ 


Xi  -x^ 


_ i_  ^  \ 


i^i(Xi)  =  -q^ 

•ii(Xi)  =  q,  fj 


(xp  =  -qj  f  1 "  qr  Xj 


and 


-k  -k 


The  points  f  — letermlne  a  change  In  the  expressions  we 


-  Xi  X^  -  X-. 


btain  for  the  derivatve  -f  each  with  respect  to  X  .  The 

If  rivatlve  of  with  reopect  to  X  will  also  change  at  those  points 

(2m  at  most).  But  we  are  only  interested  in  those  which  belorig  ti  ^0,1]. 
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Lc-t  us  define 

a  ~  ^  3  -  ~  ^ 

{^3}  =  [0,1,  ,  i  =  l,...,m  I  n  ^0,1] 


-  X  ^  Xi  -  X . 


and  let 


i:  = 


-  k 

“1  -’^l 


i:  = 


i:  =  i 


Tf  1  c  l5  ,  that  means  that  on  the  Interval  [k  ,  ^  ,]  the.  derivative 

X  S  S  I  X 

^  Ic  •  ic  s 

[x^)  takes  on  the  value  lj_(x^  “  ^  i  « 


k 

-  k 

^i 

- 

-  k 

“i 

-  ^i 

k 

-  k 

^i 

-  ^i 

-  k 

»i 

-  ^1 

s  +  1  *  s  + 


1  ‘ 


<'  \  <'  \ 


a  “  ^ 

.  ^  i 

s  +  1—  k  -k*  ^s*^s+l*®^^s^ 
Xi-  Xj 


k  -  k  ^  ^s 

Xi  -  Xi 


thl 


rd  form  of  the  derivative  of  ^5,(X^.  F^r  w-  g'-t: 


4.V) 


;=!  iTif  1^ 


+  ,  k  -  k  x 
li(Xi  -  X  j  ) 


2  ^  ■  ^1'/ 

i  e  To  i  Ci®  or. 


A  simple  algebraic  manipulation  gives  us  (^).  It  is  very  easy  to  see  how 

s  s  s 

the  construction  of  the  sets  and  hav^  to  be  modified  if 

k  -  k  , 

X^  -  X  .  <0. 


